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Abstract 

The processes underlying the perceptual analysis of visual form are believed to have little interaction 
with those subserving the perception of visual motion [Livingstone and Hubel, 1987; Victor and Conte, 
1990]. Recent reports of functionally and anatomically segregated parallel streams in the primate visual 
cortex seem to support this hypothesis [Ungerlieder and Mishkin, 1982; VanEssen and Maunsell, 1983; 
Shipp and Zeki, 1985; Zeki and Shipp, 1988; De Yoe et al., 1994]. Here we present perceptual evidence 
that is at odds with this view and instead suggests strong symmetric interactions between the form and 
motion processes. In one direction, we show that the introduction of specific static figural elements, say 
'F', in a simple motion sequence biases an observer to perceive a particular motion field, say 'M'. In the 
reverse direction, the imposition of the same motion field 'M' on the original sequence leads the observer 
to perceive illusory static figural elements 'F'. A specific physiological implication of this finding concerns 
the possible existence of (what we call) motion end-stopped units in the primate visual system. Such units 
might constitute part of a mechanism for signalling subjective occluding contours based on motion-field 
discontinuities. 
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1 Introduction 

Our claim of strong reciprocal interactions between the 
analyses of two-dimensional visual form and motion rests 
on the demonstration that for a large class of simple mo- 
tion sequences, changes in the perceived static 2D figural 
elements can cause, and be caused by, modifications in 
the perceived 2D motion-field. The motion sequences 
we use are two-dimensional animations comprising of 
simple geometric figures translating under stationary oc- 
cluding patches. These patches obscure the moving fig- 
ures' vertices. Figure 1(b) shows a typical sequence (for 
ease of exposition, we shall work exclusively with this 
sequence (call it sequence 'A') in this paper). It was 
created by moving a diamond shaped wireframe hori- 
zontally back and forth under three stationary vertical 
occluders (figure 1(a)). The diamond's extent of transla- 
tion was limited to ensure that none of its vertices were 
ever visible. The occluding strips were assigned exactly 
the same gray-level as the background, thereby rendering 
their boundaries invisible. 
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Figure 1: (a) The setup used in our experiments. (There 
is no physical significance to the absolute depth differ- 
ences between the occluders, diamond and background 
shown in this figure. They are indicative only of the 
depth ordering used to generate the 2D motion se- 
quences.) We used the Macromind Director software 
package running on a Macintosh Quadra 700 to gen- 
erate the sequences. The sequences were presented on 
a 16" monochrome monitor and subtended 7 degrees of 
visual angle at a viewing distance of 80 cm. The dia- 
mond's speed of oscillation was 0.7 degrees per second, 
(b) Three frames from sequence 'A': the diamond oscil- 
lating horizontally behind occluders that have exactly the 
same gray-level as the background. 

We performed two sets of experiments. The first set 
was designed to study how a change in the figural as- 



pects of sequence 'A' could effect its motion percept. 
The second set examined the possibility of a reciprocal 
influence - a change in sequence 'A's perceived motion 
field influencing its perceived figural content. 

2 Experiment 1: The influence of form 
on motion 

2.1 Methods: 

Our subjects were five MIT graduate students, naive as 
to the purpose of the experiment. The experiment had 
two parts. In part one, the subjects were individually 
shown ten presentations (each lasting 5 seconds) of se- 
quence 'A'. They were instructed to verbally report, after 
each presentation, the dominant direction of perceived 
motion (horizontal, diagonal or vertical). 

For part two of the experiment, we created a new 
sequence (sequence 'B') by modifying sequence 'A' to 
explicitly suggest the presence of the occluding strips 
(figure2(a)). The presentation schedule for part one was 
repeated with sequence 'B'. 

2.2 Results and Discussion: 

Figure 2(b) summarizes the different results obtained 
with sequences 'A' and 'B'. The dominant percept for all 
subjects with sequence 'A' was that of vertical oscillatory 
motion (figure 3(a)) while sequence 'B' was perceived as 
having motion in the horizontal direction (figure 3(b)). 
It is important to note that the raw motion signals in 
sequences 'A' and 'B' are identical; the changes in per- 
ceived motion can therefore be justifiably attributed sim- 
ply to the differences in the static figural contents of the 
two sequences. 

Precisely how might the visibility of the strips in se- 
quence 'B' influence the analysis of motion? There are 
at least two possibilities: First, with the strips visible, 
the line terminations are interpreted as arising out of 
occlusion rather than as intrinsic features of the moving 
lines. This induces the visual system to discard their 
vertical motion [Shimojoet al., 1989; Shiffrar and Pavel, 
1991; Lorenceau and Shiffrar, 1992]. The only intrinsic 
motion signals now available are those from the interi- 
ors of the line segments. However, these motion signals 
are inherently ambiguous due to the aperture problem 
[Hildreth, 1984; Poggio et al. 1985]: for each line seg- 
ment, only the component of motion perpendicular to its 
orientation can be recovered. Second, by suggesting the 
possibility of the line-segments continuing behind them, 
the strips allow amodal grouping of the segments and the 
consequent integration of their motion signals, possibly 
by the intersection of constraints construction [Movshon 
et al. 1985]. The resultant motion is in the horizontal 
direction. 

The net effect is that instead of seeing four indepen- 
dent line-segments moving vertically, the observer now 
perceives them as moving coherently in the horizontal di- 
rection. A change in the figural content of sequence 'A' 
thus leads to a change in the perceived motion (figure 
4(a)). 



The preceding demonstration of the influence of form 
on perceived motion is not entirely new. Somewhat simi- 
lar effects have been reported earlier, though, to the best 
of our knowledge, this is the first demonstration of sub- 
jective static figural elements exerting an influence on 
perceived motion. It is also important to note that this 
influence is non-local. 

The more significant factor that distinguishes this 
study from the earlier ones is our emphasis on recip- 
rocality; we investigate the possibility of interactions in 
the opposite direction: can a modification in perceived 
motion influence perceived form? Or, in the current con- 
text, can the 'imposition' of a horizontal motion field on 
sequence 'A' result in the perception of the form of the 
occluding strips (figure 4(b))? Experiment 2 attempts 
to address this question. 

3 Experiment 2: The influence of 
motion on form 

3.1 Methods: 

Our subjects for this experiment were five naive MIT 
graduate students, different from the ones who had par- 
ticipated in experiment 1. This was done to prevent 
an influence of any experientially acquired biases from 
experiment 1 on the subjects' performance. The exper- 
iment had two parts. In part one, the subjects were 
individually shown ten presentations (each lasting 5 sec- 
onds) of sequence 'A'. They were instructed to indicate 
with a cursor on the display, after each presentation, the 
locations of any perceived subjective contours. 

For part two of the experiment, we created a new 
sequence (sequence 'C') by 'imposing' a horizontal mo- 
tion field on sequence 'A'. This was done by attaching 
to the diamond's contour point-features moving unam- 
biguously in the horizontal direction (figures 5(a) and 
5(b)). The point features were so placed as to never be 
obscured by occluders. The presentation schedule for 
part one was repeated with sequence 'C 

3.2 Results and Discussion: 

Figure 6(a) summarizes the different results obtained 
with sequences 'A' and 'C The subjects reported per- 
ceiving strong illusory contours [Petry and Meyer, 1987] 
in nearly all presentations of sequence 'C but not in se- 
quence 'A'. The responses of all subjects were in agree- 
ment regarding the locations of the perceived contours. 
The contours were seen as delimiting illusory occluding 
strips at the locations indicated in figure 6(b). Any single 
static frame from this sequence did not afford the percept 
of subjective contours. Interestingly, on subsequent pre- 
sentations of sequence 'A', four of the subjects reported 
being able to perceive subjective occluding boundaries 
simply by mentally imposing a horizontal motion field on 
the sequence; the subjective contours disappeared when 
the four line segments were seen as moving vertically. In 
essence, then, changes in the motion field, whether im- 
posed externally or internally via top-down mechanisms, 
profoundly influenced the perceived figural content for 
our subjects. 
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Figure 2: (a) Three frames from sequence 'B'. This is 
the same as sequence 'A ' except for the inclusion of a 
few static figural elements that indicate the occluders' 
presence, (b) A summary of the results obtained with 
sequences 'A' and 'B' in experiment 1. For each of the 
five subjects, the inclusion of the static figural elements 
strongly biases the percept from being one of motion in 
the vertical direction to one of horizontal motion. 
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Figure 3: (a) The reported percept with sequence 'A': 
four lines oscillating vertically independently of each 
other (b) The reported percept with sequence 'B': a par- 
tially obscured diamond translating horizontally back and 
forth behind three opaque strips. 



This demonstration of motion influencing the percep- 
tion of contours makes intuitive sense when one notices 
that the locations of the subjective contours coincide 
with the discontinuities in the horizontal motion-field 
(figure 6(b)). Given that occluding surfaces often re- 
sult in motion discontinuities, it seems reasonable for 
the visual system to use the latter to hypothesize the 
presence of the former (Michotte invoked a similar idea 
in some of his work on the perception of causality [Mi- 
chotte, 1954]). Furthermore, it is only meaningful to in- 
fer occlusion from discontinuities along the motion tra- 
jectory rather than those perpendicular to it. This is 
consistent with our aforementioned result that subjec- 
tive contours are perceived when the four segments are 
seen as moving together horizontally, but not when they 
are seen as moving vertically. 

It is worth emphasizing that our use of the term 'mo- 
tion discontinuities' has a somewhat different meaning 
than that implied in conventional usage. The motion 
discontinuities in our sequences are punctate - at any 
time, discontinuities exist at only a few points. This is 
in contrast to more conventional settings where motion 
discontinuities are used to refer to spatially extended 
and continuous contours that demarcate two different 
motion fields. The remarkable feature about the percept 
obtained with sequence 'C is that it demonstrates the 
visual system s ability to infer the presence of extended 
occluding contours from punctate motion discontinuities. 
This is completely analogous to the situation in the con- 
trast domain where given only a few punctate contrast 
discontinuities in a Kanizsa-like figure, the visual system 
infers extended subjective contours. 
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Figure 4: (a) and (b) The paradigm to test for reciprocal 
interactions between the perception of 2D form and mo- 
tion. Panel (a) schematically summarizes the result ob- 
tained with experiment 1: introducing the explicitly indi- 
cated occluding strips in sequence 'A ' yields a horizontal 
motion-field. Panel (b) is the test for reciprocity: would 
the imposition of a horizontal motion-field on sequence 
'A' yield a percept of the occluding strips? Experiment 2 
addresses this question. 



4 Physiological implications: 

The perceptual results we have described provide some 
hints regarding the nature of the corresponding physio- 
logical processes. We mention a few speculations below. 

Experiment 1 suggests that the percept of 2D pattern 
motion can be modified by varying the figural content 
of a motion sequence. Given that the medial temporal 
(MT) area is thought to be intimately involved in the 
computation of pattern motion [Movshon et al., 1985; 
Albright, 1984; Newsome and Pare, 1988; Rodman and 
Albright, 1989], this implies that it should be possible to 
modulate the activity of at least some of the MT units 
by simply modifying some static figural characteristics 
of the presented sequence. Furthermore, these modifica- 
tions can be non-local, i.e. they need not lie within the 
receptive field of the unit being monitored. Support for 
this idea comes from the fact that the results in exper- 
iment 1 were obtained by the inclusion of static forms 
(partially occluded disks) that left the local patterns of 
motion physically unchanged. These findings suggest a 
conceptually simple physiological test. The test would 
involve presenting sequences 'A' and 'B' within the re- 
ceptive field of an MT cell tuned to motion in the hor- 
izontal direction. The interesting question to ask then 
would be: does the cell respond more with sequence 'B' 
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Figure 7: A qualitative characterization of the predicted 
'motion end-stopped' units. The top panel shows how the 
response is expected to vary as a function of the extent 
of overlap between a motion field and a unit's receptive 
field. The excitatory and inhibitory regions of the re- 
ceptive field are represented by the white and speckled 
ovals respectively. As indicated in the lower panel, the 
preferred direction of the unit needs to be aligned with 
its major axis to allow it to detect discontinuities in a 
motion-field along the motion trajectory. The disconti- 
nuities can be classified into two basic categories: those 
associated with the abrupt appearance of motion and 
those associated with its abrupt disappearance. These 
discontinuities can either be detected by two different 
units with opposite preferred directions or by one unit 
that is sensitive to the motion field's orientation but not 
its sign. 



tion measurements (such as those available at the level of 
the striate cortex) or of motion signals obtained by glob- 
ally integrating the local measurements (such integration 
could be performed by the medial temporal area). We 
investigate this issue using a sequence ('D') that yields 
motion fields that are locally identical to but globally 
different from those produced by sequence 'C Sequence 
'D' is the same as sequence 'C except for having the di- 
amond oscillate vertically instead of horizontally (figure 
8(a)). Owing to the aperture problem, a vertically oscil- 
lating diamond yields local patterns of motion that are 
identical to those produced by a horizontally moving one 
(figure 8(b)). (More specifically, over the course of every 
oscillation cycle, sequence 'D' yields the same local pat- 
terns of motion of the eight line terminations as sequence 
'C, albeit with different phase shifts.) If local motion 
measurements subserved the perception of contours, se- 
quence 'D' would be expected to yield the percept of 
occluding boundaries just as sequence 'C does. On the 
other hand, if the contour signalling mechanism oper- 
ated on the global motion field, the prediction would be 
very different. Sequence 'D' has no discontinuities along 
the motion trajectories in its global motion field (figure 
8(c)) and would not, therefore, be expected to yield the 
percept of contours. The results unequivocally support 
the latter alternative. None of the five subjects tested 
(the participants of experiment 2) reported perceiving 
any subjective contours in sequence 'D'. 

Taken together, our findings with sequences A, B and 
C strongly suggest tight reciprocal interactions between 
processing mechanisms in the 2D form and motion do- 
mains. We have obtained similar results with several 
other such sequences in both the 2D and 3D domains. 
We are therefore led to suggest that to be able to account 
for these results, the notion of independent streams of 
analysis in the visual system needs to be augmented with 
mechanisms to permit extensive crosstalk. Our hypo- 
thetical 'motion end-stopped' unit might be part of one 
such mechanism. 
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